Staged Training of Neocognitron by Evolutionary Algorithms
نویسنده
چکیده
The Neocognitron, inspired by the mammalian visual system, is a complex neural network with numerous parameters and weights which should be trained in order to utilise it for pattern recognition. However, it is not easy to optimise these parameters and weights by gradient decent algorithms. In this paper, we present a staged training approach using evolutionary algorithms. The experiments demonstrate that evolutionary algorithms can successfully train the Neocognitron to perform image recognition on real world problems.
منابع مشابه
Neocognitron's Parameter Tuning by Genetic Algorithms
The further study on the sensitivity analysis of Neocognitron is discussed in this paper. Fukushima's Neocognitron is capable of recognizing distorted patterns as well as tolerating positional shift. Supervised learning of the Neocognitron is fulfilled by training patterns layer by layer. However, many parameters, such as selectivity and receptive fields are set manually. Furthermore, in Fukush...
متن کاملDetermining Selectivities in the Neocognitron
In Fukushima's neocognitron, the S-cell selectivity parameters have a profound eeect on the classiication performance of the network. To date, no one has presented a successful approach to determining these parameters so as to maximize the neocognitron's correct recognition rate. This paper presents two new algorithms for adjusting S-cell selectivities. The rst method | Sub-Optimal Feature Trai...
متن کاملUsing CMU PIE Human Face Database to a Convolutional Neural Network - Neocognitron
This work presents the application of Neocognitron to the human face recognition. Using a large-scale human face database (CMU PIE), the optimal thresholds of the Neocognitron to human face recognition are verified. During the first experiment, increasing the activation thresholds of the Neocognitron, their best values to be used in the second experiment, increasing the number of training image...
متن کاملEvaluation of Two Neocognitron-type Models for Recognition of Rotated Patterns
We examine the number of cells and execution time taken to correctly recognize rotated patterns in two models: a rotation-invariant neocognitron (RNeocognitron) and a neocognitron-type model (TDR-Neocognitron) which recognizes rotated patterns by use of an associative recalled pattern. In numerical simulations handwritten patterns in CEDER database are used for training and evaluation of recogn...
متن کاملEstimation of LPC coefficients using Evolutionary Algorithms
The vast use of Linear Prediction Coefficients (LPC) in speech processing systems has intensified the importance of their accurate computation. This paper is concerned with computing LPC coefficients using evolutionary algorithms: Genetic Algorithm (GA), Particle Swarm Optimization (PSO), Dif-ferential Evolution (DE) and Particle Swarm Optimization with Differentially perturbed Velocity (PSO-DV...
متن کامل